An Enhanced Spatiotemporal Visual Attention Model for Sports Video Analysis
نویسندگان
چکیده
Inspired by the human visual system, visual attention (VA) models seem to provide solutions to problems of semantic image understanding by selecting only a small but representative fraction of visual input to process. Having proposed a spatiotemporal VA model for video processing in the past, we propose considerable enhancements in this paper, including the use of steerable filters for 3D orientation estimation, and of PCA for fusion of features for the construction of saliency volumes. We further employ segmentation and feature extraction on salient regions to provide video classification using an SVM classifier. Finally, we provide results on sports video classification and comment on the usefulness of spatiotemporal VA for such purposes.
منابع مشابه
On the Use of Spatiotemporal Visual Attention for Video Classification
It is common sense among experts that visual attention plays an important role in perception, being necessary for obtaining salient information about the surroundings. It may be the “glue” that binds simple visual features into an object [1]. Having proposed a spatiotemporal model for visual attention in the past, we elaborate on this work and use it for video classification. Our claim is that ...
متن کاملA Bottom-Up Spatiotemporal Visual Attention Model for Video Analysis
A video analysis framework based on spatiotemporal saliency calculation is presented. We propose a novel scheme for generating saliency in video sequences by taking into account both the spatial extent and dynamic evolution of regions. Towards this goal we extend a common image-oriented computational model of saliency-based visual attention to handle spatiotemporal analysis of video in a volume...
متن کاملSalient Region Detection in Video Using Spatiotemporal Visual Attention Model
Abstract Salient region detection is very useful in video analysis. A salient region detection method based on spatiotemporal visual attention model is proposed in this paper. Visual attention mechanism is used to generate saliency map of the image sequence. Spatial saliency map is computed in accordance with some predefined features including intensity, color and orientation. Temporal visual s...
متن کاملA scheme for racquet sports video analysis with the combination of audio-visual information
As a very important category in sports video, racquet sports video, e.g. table tennis, tennis and badminton, has been paid little attention in the past years. Considering the characteristics of this kind of sports video, we propose a new scheme for structure indexing and highlight generating based on the combination of audio and visual information. Firstly, a supervised classification method is...
متن کاملAudiovisual Attention Modeling and Salient Event Detection
Although human perception appears to be automatic and unconscious, complex sensory mechanisms exist that form the preattentive component of understanding and lead to awareness. Considerable research has been carried out into these preattentive mechanisms and computational models have been developed for similar problems in the fields of computer vision and speech analysis. The focus here is to e...
متن کامل